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Abstract 

We present an unsupervised, local activation- 
dependent learning rule for intrinsic plasticity (IP) 
which affects the composition of ion channel conduc- 
tances for single neurons in a use-dependent way. 

We use a single-compartment conductance-based 
model for medium spiny striatal neurons in order to 
show the effects of parametrization of individual ion 
channels on the neuronal activation function. We 
show that parameter changes within the physiological 
ranges are sufficient to create an ensemble of neurons 
with significantly different activation functions. We 
emphasize that the effects of intrinsic neuronal vari- 
ability on spiking behavior require a distributed mode 
of synaptic input and can be eliminated by strongly 
correlated input. 

We show how variability and adaptivity in ion chan- 
nel conductances can be utilized to store patterns 
without an additional contribution by synaptic plas- 
ticity (SP). The adaptation of the spike response may 
result in cither "positive" or "negative" pattern learn- 
ing. However, read-out of stored information depends 
on a distributed pattern of synaptic activity to let in- 
trinsic variability determine spike response. We briefly 
discuss the implications of this conditional memory on 
learning and addiction. 

Keywords: single neuron model, striatal medium 
spiny neuron, ion channels, activation function, unsu- 
pervised learning, intrinsic plasticity, pattern learning, 
neuronal variability 

Introduction 

A role for modification of activation functions, 
or intrinsic plasticity (IP), for behavioral learning 



has been demonstrated for a number of systems 
g and Linden, 2003] . For instance, in rabbit eye- 
blink conditioning, when ion channels related to af- 
terhyperpolarization are being suppressed by a learn- 
ing event, they can become permanently suppressed. 
This has been shown for pyramidal cells of hippocam- 
pal areas CA1 and CA3, and for cerebellar Purk- 
inje cells |Schreurs et al., 1 998 . In some cases, these 
changes are permanent and still present after 30 days 
|Moyer et al., 19961 |Thompson et al., 1996| , in other 
cases, intrinsic changes disappear after 3-7 days, while 
the behavioral memory remains intact, raising ques- 
tions about the long-term component of intrinsic plas- 
ticity in these systems. There are at the present time 
conflicting ideas on the significance of IP compared 
to synaptic plasticity |Zhang and Linden, 2003| , and 
the range of functions that IP may have in adaptivity 
|Destexhe and Marder, 2004| . 

Few computational models have been proposed that 
show how modification in activation functions can be 
achieved with ion channel based models of realistic sin- 
gle neurons. Marder and colleagues have developed 
an approach, where they sample a very large param- 
eter space for conductances of ion channels, explor- 
ing nonlincarities in the relation between conductances 
and neural spiking behavior |Goldman et al., 2001 
|Prinz and Marder, 2004| . The motivation for this re- 
search are observations about neuromodulation and in- 
trinsic plasticity in specific neurons of an invertebrate 
ganglion (e.g., |LeMasson et al., 1993| ). They have 
noted that large variations in some parameters may 
have little effect on neuronal behavior, while compar- 
atively small variations in certain regions in parame- 
ter space may change response properties significantly. 
They also suggest that neuromodulation may provide 
an efficient means of targeting regions in parameter 
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space with significant effects on response properties 

IGoldman et al., 2001|. 

A study by |Stemmler and Koch, 1999| assumed 
the goal of modification of activation functions is to 
achieve an optimal distribution of firing rates for a 
population of neurons. The idea was that by tuning 
each neuron to a different band of the frequency spec- 
trum, the full bandwidth of frequencies could be em- 
ployed for information transfer. This goal was achieved 
by adjusting Na + , K + and Ca ++ channels for a gener- 
ically defined neuron until a desired frequency was sta- 
bly reached. 

We present a different approach, where the modi- 
fication of activation functions reflects the history of 
exposure to stimuli for a specific neuron. Similarly, 
|Daoudal and Debanne, 2003| suggested that synaptic 
LTP /LTD and linear regulations of intrinsic excitabil- 
ity could operate in a synergistic fashion. However, 
in our approach, different types of synaptic stimu- 
lation result in state changes for the neuronal unit, 
influencing its capacity for read-out of stored intrin- 
sic properties. Thus, intrinsic plasticity is concep- 
tualized as fundamentally different from LTP/LTD 
which does not encompass such a state change. The 
learning rule that we derive as the basis for adjust- 
ment concerns one-dimensional upregulation or down- 
regulation of excitability in the "read-out" state of the 
neuron, and affecting only this state. This rule uses 
neural activation, significantly determined by intracel- 
lular calcium for the learning parameter, which can 
be shown to be biologically well-motivated (cf. also 
|LeMasson et al., 1993| ). 

Materials and Methods 

Striatal medium spiny neuron 

The membrane voltage V m is modeled as V m = 
— <?Ei-^ ~ Isyn}- The individual currents are mod- 
eled by conductances, state variables and the reversal 
potential: 

h = 9i {V m )* m Pi *hf*(V m - El ev ) ( 1 ) 

The dynamics arc defined using state variables for ac- 
tivation (m) and inactivation (h). The types of equa- 



tions used for the dynamics are: 
1. exponential: f(V m ) = \exp( v ™~ Vi ) 



2. logistic: f(V n , 



l+cxp( ™ Vr ' ) 
_ \(V m -Vj) 



3. linexp: f(V m ) = — ,v m - Vi , 

l+exp( _ Vc ) 

The state variables can be defined indirectly using 



and 



m = (1 — m)a — m(3 



h = (1 - h)a - h(3 



and one of the equations (1-3) with different values for 
A (X a ,Xp), Vi (Vf, Vf) and V c (V c a , V*). We use this 
method for the ion channels in Table [I] 

The state variables can also be directly defined (cf. 
IGoldman et al., 2001| ): 



m 
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h = 



n 



The parameters used are moo = wiO, /loo = hO, r rn and 
Th as in Table [21 Again, we use one of the equations 
(1-3) with the A parameters (A m o and Afc,o) set to 1. 
(These representations are mathematically equiva- 



lent and related by moo = 



•) 



Clm+Pm ' °° o m +A.. 

Standard parameter values for the model- 
ing of ion channels ('naive state') were com- 
pared with several publications. Parameter val- 
ues for Ik, In a and Ii ea k were adapted from 
| Wang and Buzsaki, 1996| , for L-type calcium 
channels (Icol) from |Bargas et al., 1994| and 
|Tsubo et al., 2004| , see TableHJ 

Parameters for slow A- type K channels (I As) 
were adapted from |Gabel and Nisenbaum, 1 998 
|Nisenbaum et al., 1998| , for fast A- type K 
channels (/a/) from |Surmeier et al., 1989| , 
for inward rectifying K channels (I Kir) from 
|Nisenbaum and* Wilson, 1995| , and the 



re- 



sulting parameter tables were compared with 
|Mahon et al., 2000b| and |Gruber et al., 2003| , see 
Table 
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Variability 

The maximum conductance of different ion channels 
can be expressed by a scaling factor in the mem- 
brane potential equations as in Eq. [2] (for synaptic 
currents) or Eq. (for synaptic conductances), cf. 
IGruber et al., 2003| . 

V m = --pq\pill + H2h ■■■+ fJ-Ji - Lyn] (2) 



Vm = ~^ bah + -.- + 9s (V m - V )] (3) 

Both NM-independent and NM-dependent modifi- 
cations may coexist in a neuron, as expressed in Eq.0] 
( [NM] stands for the level of synaptic availability of a 
neuromodulator NM). 



V m = --[{^h + [NM] Kl h) + ( m I 2 + [NM}K 2 I 2 ) . . .] 

(4) 

In this paper, for simplicity, we shall refer to (Eq. |2} 
as the generic format for intrinsic adaptation, with the 
understanding that ^ is replaceable by [NM]k. 

Physiological ranges for /1 can be estimated by var- 
ious means. There are measurements for variabil- 
ity in eletrophysiologically defined membrane behav- 
ior (current threshold, spike response to current pulses 
etc. |Onn et al., "20031 |Mahon et al., 2000a| ) that are 
typically expressed as standard errors (e.g. 16-20% 
for current threshold, |Onn et al., 2003| ). There are 
also attempts at classifying MSN cells into differ- 
ent 'types' based on their electrophysiological profile 
IWickens and Wilson, 19981 |Onn et al., 2000| . Mod- 
eling shows that variability of ion channel conduc- 
tances with a range of ±40% matches measures 
of electrophysiological variability and reproduces the 
ranges for MSN types (data not shown). Interest- 
ingly, direct measurements for dopamine Dl receptor- 
mediated changes on ion channel conductances are 
approximately in the same ranges (±30 — 40%, 
|Gruber et al., 2003] ). Our discussion is thus based on 
an estimate of /1 ranging fom 0.6 - 1.4 for each channel. 



Defining synaptic input 

Synaptic input is defined by overlays of the EPSPs gen- 
erated by N individual Poisson-distributed spike trains 
with mean interspike interval T syn . Each EPSP is mod- 
eled as a spike with peak amplitude Iq — 1.2/iA/cm 2 
and exponential decay with r = 2.5ms similar to 
|Tsubo et al., 2004[ |Sachdev et al., 2004| . IPSPs are 
modeled in a similar way with Iq = —0A^A/cm 2 . This 
corresponds to 0.5nA (-0.2nA) as peak current (with 
InA — 2.3fiA/cm 2 ). Synaptic conductances are calcu- 
lated by g syn = I syn /(V m - V ) with V set to OmV. 
We have tuned the model to g syn = 0.0035mS/cm 2 
for a first spike for the naive or standard neuron (all 
pi = 1). At -40mV, this is 0.0035m5/cm 2 *(-40ml/) = 
— 1 Apt, A/ cm 2 or 0.6nA, which corresponds to the ex- 
perimentally measured average value for the rheobase 
in |Onn et al., 2003| . We may increase the correla- 
tion in the input by using a percentage W of neurons 
which fire at the same time. Higher values for W in- 
crease the amplitude of the fluctuations of the input 
(cf. |Benucci et al, 2004| ). 

Implementation 

The simulator has been implemented in Matlab and 
executed on an Apple 1GHz G4 notebook. The en- 
tire code is interpreted and no specific code optimiza- 
tions have been applied. For numerical integration, the 
solver ode45 was used. Simulation of one neuron for 1 s 
took approximately 68s CPU time. It is expected that 
for compiled and optimized code the simulation speed 
could be increased by at least an order of magnitude. 

Results 

Intrinsic Variability 

We explore the impact of small variations in ion chan- 
nel conductances on the shape of the activation func- 
tion. As an example, we show the current and con- 
ductance changes for a slowly inactivating A-type K+ 
channel (Kvl.2, Ias), L-type calcium channel (Icah) 
and inward rectifying K+ channel {I Kir) at different 
membrane potentials modulated by a scaling factor 
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H = {0.6,0.8,1.0,1.2,1.4} (Fig. [J Fig. Regula- 
tion of the voltage-dependence |Misonou et al., 2 004 
and even of the inactivation dynamics of an ion chan- 
nel [Hayashi da and Ishida, 2004| has also been shown, 
but these effects are not further discussed here. 

We can see that there are critical voltage ranges 
(around -50mV, around -80mV and starting at - 
40mV), where the conductance and the current are 
highest, and where scaling has a significant effect, 
while scaling has small or no effect in other voltage 
ranges. (The Na+ current has been disabled for this 
example to prevent the neuron from firing). 

In Fig. |21 we show the current over time - to graph- 
ically display the slow dynamics of the Ias and IcaL 
channel. Since we do not change the activation- 
inactivation dynamics of any channel in our model, 
we show currents only for (j,a s , /JcaL = 1- 

We can see that Ia s activates moderately fast 
(20ms), while it inactivates with a half-time of about 
300ms, depending on the voltage. For Ic a L> activation 
is almost instantaneous, but inactivation is > 500ms. 

The activation function for the MSN model shows a 
time-dependence only in the high-voltage range (at or 
above -55mV), whereas the components in the lower 
voltage ranges are not time-dependent. 

Mathematically, we can consider the individual 
channels as a set of basis functions that allow func- 
tion approximation for the activation function. Each 
particular adjustment of an activation function can be 
considered learning of a filter which is suited to a spe- 
cific processing task. The activation-inactivation dy- 
namics would provide a similar set of basis functions 
for the temporal domain. Of course, it is interesting 
to note which particular basis functions exist, and also 
how the temporal dimension is tied in with specific 
voltage-dependences. For instance, the slowly inacti- 
vating potassium channel Ias provides a skewed mirror 
image of the function of calcium-gated Sk/BK chan- 
nels, which are responsible for afterhyperpolarization, 
making different variants of frequency filters possible. 
On this basis, a mapping of ion channel components 
and their density or distributions in different types of 
neurons could provide an interesting perspective on di- 
rect interactions for neurons from different tissue types 
or brain areas, as well as e.g. between cholinergic in- 
terneurons and MSNs within striatum. 



To further explore the influence of variability of the 
activation function, we apply realistic synaptic input 
with different amounts of correlation to individual MS 
neurons (see Fig.0J. 

This shows us that small adjustments in the con- 
tribution of a specific ion channel can result in sig- 
nificantly different spiking behavior even for identical 
synaptic input. This occurs when the input is dis- 
tributed, i.e. has low correlation. In this case, the 
neurons spike independently of each other and with 
different frequencies. We can eliminate this effect by 
increasing the correlation of the input. Because of the 
slow activation/inactivation dynamics of the Ia s chan- 
nel, (latency of « 20ms) only low correlated input acti- 
vates these channels ('neuronal integrator mode'), but 
highly correlated inputs do not activate these channels, 
driving the membrane to spiking quickly ('coincidence 
detector mode'). Therefore correlated input can pro- 
duce reliable spiking behavior for model neurons which 
differ in the relative contribution of the slow Ia s chan- 
nel. Distributed input, in contrast, activates slower ion 
channels, and can produce different tonic firing rates, 
here according to the contribution of the Ias channels, 
as long as strong synaptic input keeps the neuron in 
the relevant voltage range ('persistent activity'). 

Similarly, the differential contribution of other 
channels (high-voltage gated L-type Ca-channels, 
hyperpolarization-activated GIRK channels or 
calcium-dependent Sk/Bk channels) will affect neu- 
ronal behavior, when the conditions for a prominent 
influence of these channels are met. 

We are modeling a state of MS neurons that ex- 
hibits regular tonic firing. In experimental studies, 
Wil son and K awaguc hi, 1996] showed that MS neu- 
rons, similar to cortical neurons, exhibit upstate- 
downstate behavior, reminiscent of slow-wave sleep, 
under certain forms of anesthesia (ketamine, barbitu- 
rate). However, under neuroleptanalgesia (fentanyl- 
haloperidol), |Mahon et al., 2003| showed that MS 
neurons can show driven activity, when cortical input 
is highly synchronized, and exhibit a state character- 
ized by fluctuating synaptic inputs without rhythmic 
activity (i.e. without upstates/downstates), when cor- 
tical input is desynchronized. The regular, tonic spik- 
ing in this state is very low, much less than in the 
waking animal, which may be related to the dopamine 
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block by haloperidol. This makes a waking state of 
MS neurons characterized by regular tonic spiking at 
different firing rates probable. 

In the following, we show how intrinsic excitability 
adaptation can lead to different recalled firing rates 
under appropriate synaptic stimulation. The model 
could thus reflect learning that is recalled or read out 
during MSN states under desynchronized cortical in- 
put - in contrast to highly synchronized input, which 
would homogenize the response of the coincidence de- 
tecting neurons and favor reliable transfer of spikes. 

Induction and Maintenance of Plasticity 

The general idea for learning intrinsic plasticity is to 
use a learning parameter h for each individual update 
of the conductance scaling factor /z. The direction of 
learning (h > or h < 0) is determined from the neu- 
ral activation (A n ) for each individual neuron. Neural 
activation is largely determined by intracellular cal- 
cium but here we estimate the neural activation A n 
from the spike rate of the neuron, measured over 1 s 
of simulated behavior (see D for a discussion). 

We define a bidirectional learning rule dependent 
on an initial firing rate 6: excitability is increased by 
a step function h (with stepsize a) when A n is greater 
than 6, excitability is decreased when A n is lower than 
8 ("positive learning"). This means, when the actual 
neural activation is higher than the initial firing rate, 
membrane adaptations aim to move the neuron to a 
higher excitability in order to create a positive memory 
trace of a period of high activation (which can then 
be replicated under distributed synaptic stimulation). 
The same mechanism applies to lower the excitability 
of a neuron. 

A^i = h(A n ) = a if A n > 6 , . 

Afi = h(A n ) = -a HA n <9 [a> 

This rule can also be implemented by individ- 
ual increases in excitability after each action po- 
tential, and decreases of excitability for periods of 
time without action potentials. Initial experiments 
|Mahon et al., 2003| |Zhang et al., 2004| indeed show 
such adaptation of intrinsic excitability after individ- 
ual spikes. 



The function h can be applied to a single ion chan- 
nel, such as I As , but also to a number of ion channels in 
parallel: e.g. to mimic dopamine Dl receptor activa- 
tion, h may be applied to fiAs (upregulated with high 
An), UN a (downregulated with high A n ), and fi Ca L 
(downregulated with high A n ). 

Pattern Learning 

We can show the effect of this learning rule on pattern 
learning. We generate synaptic inputs from a grid of 
200 input neurons for a single layer of 10 MSNs. On 
this grid we project two stripes of width 4 as a simple 
input pattern Pi ea m by adjusting the mean interspike 
interval (ISI) for the corresponding input neurons to a 
higher value (ISI = 350 ms for on vs. 750 ms for off 
neurons, see Fig- El - 

We apply the learning rule to each of the currents 
Ino,, IcaL and Ias- This mimics changes in dopamine 
Dl receptor sensitivity, which targets these ion chan- 
nels. Adaptation can be weaker or stronger, depend- 
ing on learning time (e.g., er=0.01, i=20s (20 steps) 
(weak), i=40s (40 steps) (strong)). After a number of 
steps, we achieve a distribution of /i- values that reflects 
the strength of the input (Table [3] A) . 

In Fig. El we obtain spike frequency histograms 
from the set of MS neurons under different conditions. 
Fig. A shows the naive response to the input pat- 
tern Pieam - high activation in two medial areas. Af- 
ter adaptation, this response is increased (Fig. [H] B). 
When we apply a test input of a random noise pattern 
Pnoise , we see that the learned pattern is still reflected 
in the spike histogram (Fig. HJ]C). For positive learn- 
ing, this process is theoretically unbounded, and only 
limited by the stepsize and the adaptation time. A sat- 
uration state could be defined to prevent unbounded 
learning, which would also allow to perform capacity 
calculations. 

We should note that applying just one pattern con- 
tinuously results in a very simple learning trajectory: 
each update results in a step change in the relevant 
ion channel currents. However, we also show that the 
effects of stepwise adaptation of individual ion chan- 
nels do not necessarily lead to a completely parallel 
adaptation of firing rate. In Fig. we see that adap- 
tation is much stronger for high input rather than low 
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input neurons. In this case, 9 at 11.5Hz is a fairly low 
value for neurons to continue to lower their firing rate 
with stepwise adaptation of the chosen ion channels. 
This shows the importance of using appropriate tun- 
ing ('harnessing') mechanisms to make highly nonlin- 
ear channels work in a purely linear learning context. 

Clearly one of the results of learning is an altered 
spiking behavior of individual neurons dependent on 
their history. It is important to realize that this rule 
is based on neural activation, not synaptic input as a 
learning parameter - since synaptic input is constant 
during learning. 

Positive and Negative Trace Learning 

We show that this mechanism can be employed not 
only for positive trace learning, when excitability 
adaptation corresponds to frequency response, but also 
for negative trace learning, when excitability adapta- 
tion counteracts frequency response and approximates 
a target firing rate 9. This target rate could be set as a 
result of global inhibitory mechanisms corresponding 
to the expected mean Ai values under physiological 
stimulation. Accordingly, the neuron responds with 
decreases of excitability to high input ranges and in- 
creases of excitability to low input ranges (Fig. |5J. 

A^ = h(A n ) = -a if A n > 9 

A^ = h(A n ) = a HA n <9 ( ' 

This emphasizes that "homeostatic" responses - ad- 
justing excitability in the opposite direction to the 
level of input - can implement trace learning (pattern 
learning and feature extraction) as well. 

Negative learning rule results in a mirror image of 
parameter values compared to positive learning, as 
shown in Table |2|B. The naive response is the same as 
before (Fig. [5] A). But here, after adaptation, the neu- 
rons have habituated to the input, and do not produce 
a strong response anymore (Fig.[7|A). When neurons 
are tested with P no i se , an inverse version of the original 
pattern appears (Fig. 0B). Similarly, when we apply 
a different pattern Ptest, we obtain a spike histogram, 
where the learned pattern is overlayed with the new 
input, resulting in a dampening of the frequency re- 
sponse for Ptest (Fig.dC). 



For both positive and negative traces, learning is 
pattern-specific, i.e. training with homogeneous, fluc- 
tuating (high-low) noise, such as P no ise, results in no 
adjustments (or computes an average). However, any 
prolonged sequence of neuron-selective stimulation re- 
sults in neuron-selective patterns. This requires the 
population to be protected from prolonged stimulation 
with random patterns in a biological setting. We may 
assume most patterns to be meaningful and highly 
repetitive, while the neuron exists in a plastic state, 
while patterns may be random, when the neuron is 
not plastic (because it is stimulated with highly cor- 
related or very low frequency input, saturated in its 
parameters or undergoes ion channel block by selected 
neuromodulators) . 

Discussion 

Experimental results on induction of in- 
trinsic plasticity 

A number of experimental results show that intrin- 
sic plasticity in MSNs may be prominently induced 
and regulated by intracellular calcium: It has been 
shown that e.g. the regulation of delayed rectifier K + - 
channels (Kv2.1 channels) is effectively performed by 
Ca 2+ influx and calcineurin activation in cultured hip- 
pocampal neurons, which can be achieved by gluta- 
mate stimulation M isonou et al., 2004] . The regula- 
tion concerns marked dephosphorylation (reduction of 
conductance) plus a shift in voltage-dependence. It 
has also been shown that 20 s of NMDA stimulation, 
or alternatively, increase of intracellular calcium, in- 
creases functional dopamine Dl receptor density at 
the membrane, which corresponds to an alteration in 
k for Dl parameters, targeting a number of ion chan- 
nels simultaneously |Scott et al., 2002| . For deep cere- 
bellar neurons, there has recently been some direct 
evidence on the conditions that induce intrinsic plas- 
ticity. Here, alterations in intrinsic excitability can be 
induced by bursts of EPSPs and IPSPs, accompanied 
by dendritic calcium transients |Zhang et al., 2004| . In 
striatal MSNs, it has been determined that synaptic 
stimulation at 1 Hz does not cause significant cal- 
cium signals, but 10 Hz stimulation causes moderate 
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increases, and higher stimulation (up to 100Hz) signif- 
icantly raises calcium levels |Bonsi et al., 2003] . 

In the simulations, neural activation (A n ) is esti- 
mated from the number of spikes generated, mea- 
sured over the simulated behavior. In the model 
case, the membrane potential is not used as a sepa- 
rate parameter, because membrane potential and spik- 
ing behavior are closely linked. However, when a 
neuron exhibits prominent upstates (periods of high 
membrane voltages with a variable number of ac- 
tual spikes), membrane potential may need to be 
treated as an additional, independent component of 
A n , since a great part of the intracellular calcium sig- 
nal in striatal MSNs is being generated from high- 
voltage activated NMDA and L-type calcium channels 
|Carter and Sabatini, 2 004 . The number of spikes 
produced nonetheless seems important because of the 
phenomenon of backpropagating spikes. Backpropa- 
gating spikes enhance the calcium signal, thus provid- 
ing a basis for a prominent role for spiking behavior, or 
firing rate, for defining intracellular calcium. The pres- 
ence of backpropagation of spikes has recently been 
confirmed for MSNs |Carter and Sabatini, 2004| . 

In general, the induction of intrinsic plasticity may 
be linked not only to intracellular calcium. There ex- 
ists an intricate intracellular system of interactions be- 
tween diffusible substances like calcium and cAMP, as 
well as a number of crucial proteins (RGS, calcineurin, 
PKA, PKC, other kinases and phosphatases) for regu- 
lating receptor sensitivity and ion channel properties, 
which are furthermore influenced by NM receptor ac- 
tivation. Thus the learning parameter h may be ana- 
lyzed as being dependent not only on A n , but also on 
[iVM] , and possibly even a third variable for a - slowly 
changing - intracellular state. 

Synaptic vs. Intrinsic Plasticity 

Learning by intrinsic excitability seems particularly 
suitable for striatal MSNs, since they have few lat- 
eral connections, which provide only a small part of 
their total input |Tepper et al., 2004| . When we have 
strong recurrent interaction, as in cortex, intrinsic ex- 
citability learning needs to adjust activation functions 
relative to each other, e.g. to ensure optimal distribu- 
tion of activation functions. This probably happens in 



the cortical maps, such as frequency maps in auditory 
cortex |Bao et al, 2001] . 

In hippocampus, synaptic and intrinsic modula- 
tion may potentiate each other (E-S potentiation, 
Zha ng and Linden, 2003| ), but in other systems (e.g. 
striatum) antagonistic regulation may also exist (such 
as LTD combined with positive learning), with effects 
on the balance of synaptic vs. whole-cell localization 
for the storage of information. 



Neuromodulation 

When ion channels are regulated by neuromodulation, 
we can use a factor [NM]n - where [NM] is the extra- 
cellular concentration of the ligand and n the receptor 
sensitivity (see D Eq.0]). k stands for the influence that 
a NM signal of a certain strength has on a particular 
ion channel, i.e. the degree of coupling between NM 
receptor ligand binding and ion channel modification 
IScheler, 2004b| . Typically, a signal [NM] will regu- 
late several ion channels in parallel, but there may be 
different Ki for each ion channel. 

If activation function adaptation proceeds by NM- 
activated k parameters, rather than unconditioned /j, 
parameters, response to stimuli will consist of an early, 
non- modulated component, where the input pattern is 
reflected directly in the spiking frequency, and a later, 
modulated component, where habituation occurs for a 
learned pattern, or the stored pattern is reflected by 
overlaying a new stimulus and the stored pattern. 

NM signals orchestrate both adjustments in activa- 
tion function and synaptic input, with NM activation 
often depressing synapses, but increasing the variabil- 
ity in the activation function through selected conduc- 
tance changes (activating K-parameters) . As a result, 
the input component of the signal is reduced in com- 
parison to the stored intrinsic component after NM ac- 
tivation. Presumably, this has a dynamic component, 
such that for a short time after a strong signal there 
is an input-dominant phase which is then followed by 
an intrinsic-dominant phase. 
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Homeostasis, Permanence and Informa- 
tion Flow 

There arc different ideas at the present time what in- 
trinsic plasticity can achieve within a network model 
of neuronal interaction. A recent review of intrinsic 
plasticity |Zhang and Linden, 2003| has left the au- 
thors wondering, whether IP acts mainly to main- 
tain homeostasis, adapting to changes in synaptic 
strength by keeping neurons within certain ranges 
but without significant informational capacity, as 
in the model of |Stemmler and Koch, 19991 ■ How- 
ever, as we have shown, homeostatic adaptation 
does not exclude information storage under condi- 
tions of conditional read-out. The synergy between 
synaptic and intrinsic plasticity may take different 
forms, beyond E-S potentiation. In contrast to 
Stcmmler and Koch, 1999"! Zhang and Linden, 2003| , 



Destexhe and Marder, 2004] have listed many possi- 
ble functions and roles of intrinsic adaptive plasticity, 
based on a review of experimental evidence in different 
systems. 

We have greatly simplified the exposition here by 
concentrating on spike frequency as a major indica- 
tor of neural behavior. Certainly the type of firing 
(e.g. burst firing) is also under control of neuromod- 
ulators, and may be influenced by the distribution 
and density of ion channels. Single neuron compu- 
tation is more complex than what can be shown with 
a single compartment model. In dendritic computa- 
tion, the coupling of different compartments may be 
prominently affected by intrinsic plasticity. For in- 
stance, |Misonou et ai, 2004| showed a loss of clus- 
tering for K+ channels on the membrane, induced 
by high glutamate stimulation, indicating a possible 
input-dependent regulation of dendritic integration. 

A recent study on concurrent simulation of synap- 
tic coupling parameters and intrinsic ion channel con- 
ductances has concluded that intrinsic and synaptic 
plasticity can achieve similar effects for network op- 
eration |Prinz and Marder, 2004| . We have suggested 
that synaptic and intrinsic plasticity can substitute 
for each other, and furthermore that this essential 
functional parallelism could be an indication for in- 
formation flow over time from one modality to the 
other Schel e~2004a| . The direction of this informa- 



tion flow may be from intrinsic to synaptic for the 
induction of permanent, morphological changes (such 
as dendritic spine morphology) - however the results 
of |Nelson et al., 2 003 in cerebellum have also shown 
the possibility of permanent intrinsic plasticity (albeit 
in Purkinje cells which lack NMDA receptors and thus 
may be highly atypical neurons concerning learning 
properties). Clearly the interaction between synap- 
tic and intrinsic plasticity is still an open question. 
Here we have shown a simple, local learning mecha- 
nism for intrinsic plasticity that allows to store pat- 
tern information without synaptic plasticity. This is 
different from theoretical approaches, where activation 
functions are only being modulated to optimize global 
measures of information transmission between neurons 
while the information is exclusively stored in synaptic 
weights. Further work will be needed to investigate the 
smooth integration of synaptic and intrinsic plasticity 
and their respective functions in different systems. 

Conclusions 

We wanted to show quantitatively that IP can have 
significant effects on spike frequency, dependent on 
the statistical structure of the input. In particular, 
low correlated input, or input during sensitive (high- 
voltage membrane) states induces the strongest vari- 
ability of spike responses for different activation func- 
tions, while highly correlated input acts as drivers 
for neurons, eliminating subtle differences in activa- 
tion function. We suggested that starting from a very 
general, natural format for a learning rule, which can 
be biologically motivated, we arrive at simple pat- 
tern learning, the basis for feature extraction, and re- 
alistic types of neural behavior: population- wide in- 
creases/decreases of neural firing rates to novel in- 
put stimuli, habituation to known stimuli and history- 
dependent distortions of individual stimuli. A sig- 
nificant application of this theoretical model exists 
in the observation of pervasive whole-cell adapta- 
tions in selected ion channels (In a, Ico,l) after co- 
caine sensitization |Hu et al., 20 04 , Zhan g et al., 2002 
Zha ng et al., 1998] , with implications of the type of 
learning that underlies addiction. This would reduce 
the dynamic range of intrinsic plasticity. Potentially, 
then, learning in striatum is mediated in part by in- 
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trinsic plasticity, and a reduction in inducible intrinsic 
plasticity or dynamic range of intrinsic plasticity after 
cocaine sensitization may contribute to the pathology 
of addiction. 
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Figure 1: Variable factors (fi = {0.6 ... 1.4}) for the slowly inactivating Jf + -channel (Kvl.2, Ias), the L-type 
calcium channel (Icah), and the inward rectifying K+ channel (I Kir) are shown at different membrane voltages 
V m (A) in an I-V plot, (B) as variability in conductance. 




Figure 2: Variable factors (/i = {0.6 ... 1.4}) for Ia s , IcaL, and Ixir as components of the activation function (g s 
vs. V m ). The activation function is defined as the membrane voltage response for different injected (synaptic) 
conductances (<? s ), and computed by solving EcJSlfor the membrane voltage V m . 
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Figure 3: Activation-inactivation (temporal) dynamii 
channel IcaL, and (C) for the set of ion channels used 
Ias and overlapping inactivation dynamics in the -55 1 
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(A) for the slow A channel I^ s (B) the L-type Ca 
i the standard MSN model. We see a rise time due to 
-40 mV range. 
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Figure 4: Response to inputs generated from N — 80 neurons with independent Poisson processes using different 
correlations parameters W — 0.2,0.9 (A,B). Three slightly different neurons with has — 1-1, 1-3, 1.5 are shown 
under BOTH conditions. (A) Response variability and different firing rates for each neuron (here: 20,26,40 
Hz) occur with distributed (low correlation) input. (B) Highly correlated input produces reliable spiking and 
by implication a single firing rate (20Hz). The upper panel shows the membrane voltage, the middle panel 
shows the membrane conductances, and the lower panel shows the synaptic input as conductance. 
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Table 1: Parameter values for In a, Ik, heak as in (Wang and Buzsaki, 1996) IcaL as in (Bargas et al., 1994; 
Tsubo et al., 2004) 
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Figure 5: Pattern learning: 200 input neurons (arranged as 20X10), 10 learning neurons, and definitions for 3 
patterns. Only 37 of 80 data points for P no ise are shown. 
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Figure 6: Positive pattern learning: spike frequency histograms for 10 adaptive neurons (6 l =11.5Hz) (A) 
response of naive neurons to Pieam (B) response of Pz ea ™-adapted neurons to Piearn (C) Pz ea ™.-adapted 
neurons tested with Pnoise- Average synaptic input (nA/cm 2 ) for each neuron is shown on top. Responses in 
(A) and (B) to the same input Pi ear n are different, a pattern similar to Pi ear n emerges in response to uniform 
(noise) pattern input in (C). 
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Table 2: Parameter values for potassium channels I Kir, Ia/, I As and a slow sodium channel In as cf. (Mahon 
et al., 2000b; Gruber et al., 2003), where (a) r m = 131.4/(exp(-(V m + 37.4)/27.3) +exp((V m + 37.4)/27.3)) (b) r h = 
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Figure 7: Negative pattern learning: spike frequency histograms for 10 adaptive neurons (0=11. 5Hz) (A) 
habituation for neurons adapted to Pi ea m, (B) an inverse pattern for P; e arn-adapted neurons tested with 
Pnoise and (C) interference (dampening of response) for a new pattern Ptest (naive: line-drawn bars, adaptive: 
filled bars). Average synaptic input (nA/cm 2 ) for each neuron is shown on top. (A) shows a uniform response 
to patterend synaptic input and (B) a patterned response to uniform (noise) input. (C) shows a difference of 
response for naive vs. P/ eorn -adapted neurons to a new pattern Ptest- 
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Figure 8: Negative pattern learning: Learning results in different activation functions for high (4,8), medium 
(3,5,7,9) and low (1,2,6,10) input. 
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Table 3: Pattern learning: Parameter values (A) for positive learning with (weak/strong) adaptation of /i 
values and (B) negative learning. CaL and Na channels are adapted in the opposite direction to K channels. 
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